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(54) A method of automatically as- 
certaining and evaluating changes 
In the contents of pictures, and 
arrangement therefor 

(57) A method of ascertaining the 
contents of pictures derived from a 
location 20 being monitored (e.g. 
changes of positions of fish in 
water, or traffic in traffic flow, or 



targets moving over terrain) and de- 
termining differences between the 
contents of pictures occurring at 
intervals of time to permit evalua- 
tion thereof comprises recording the 
scene unit a TV or IR camera 21, 
scanning the recorded picture In 
lines, point-by-point and deriving 
therefrom, and a standard video 
signal, a video signal for evaluation, 
and subtracting successive said vi- 
deo signals point-by-point, the one 
from the other so as to determine 
the number of anti-coincidences 
which gives a measure of the 
change in picture content occurring 
in the period of time between the 
said successive signals. A preferred 
analyser for carrying the method 
into effect comprises the camera 
21, a signal processor 22, a com- 
puter/control unit 23 having provi- 
sion for control or prog ram e inputs, 
and a registering unit 24. 
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SPECIFICATION 

A method of automatically ascertaining and 
evaluating changes in the contents of pic* 
5 turns, and an arrangement therefor 

The invention relates to a method of automati- 
cally ascertaining and evaluating (or interpret- 
ing) changes in the contents of pictures, for 

10 example for monitoring the movement activity 
of experimental animals and a movement ana- 
lyser for carrying out the method. 

Because of increasing environmental pollu- 
tion, ever greater importance is attached to 

1 5 ascertaining the harmful concentrations of 
toxic substances. In this connection, for exam- 
ple when monitoring the quality of water, of 
the many toxic components which may be 
present can no longer be evaluated in their 

20 entirety by chemical analyses. Therefore, to 
determine the btocidic action of substances 
present in use can be made only of test 
organisms which display characteristic symp- 
toms in the presence of both known and 

25 unknown harmful substances (see, on this 
score, the Supplement to "Bild der Wissen- 
schaft", issue No. 8, August 1973, page 4). 
This indirect measuring method is thus based 
on monitoring the behaviour of organisms and 

30 also, perhaps, fish such as trout or golden 
orfes, and nowadays is used only to a small 
extent employing experts as observers; in this 
respect, on account of high staff costs, the 
monitoring cannot be carried out continu- 

35 ousry. In recent years automatically-operating 
measuring systems have been increasingly fa- 
voured when monitoring harmful substances, 
which systems have the advantage of objec- 
tive measurement without human fatigue phe- 

40 nomena expecially with short prewarning 
times. In addition, these systems lead to con- 
siderable savings in costs. 

The automatic methods for motility 
measurement which have so far become 

45 known are restricted to water organisms and 
can be split up into non-contact and contact 
methods. 

Non-contact methods: 

50 a) Optical methods: 

The organisms to be studied can move 
freely in a test basin. When swimming 
through a light barrier, a pulse is registered. 
This method is meinly applied in research. 

55 The expenditure involved in the overall moni- 
toring of a basin is, of course, technically 
practicable only if use is made of a multiple- 
barrier system, and even is then the apparatus 
involved is very expensive. Maintenance-free 

60 operation over fairly long periods of time is 
not possible, since the optical system varies in 
sensitivity as a result of vegetation growth and 
water turbidity. Added to this is the fact that 
the behaviour of the fish is influenced by the 

65 light beams which are generally bunched very 



closely together (see also German Often I e- 
gungsschrift No. 23 04 315). 

b) Electrical methods: 

70 Electrical methods have, as their basis, the 
fact that the test organisms influence an elec- 
trical field, either actively e.g. by implanted 
magnets or metal foreign bodies, or passively. 
The fteld change is measurable. The active 

75 method has the disadvantage that the fish are 
disturbed in their behaviour by the implant. 
This disturbance may be slight, it is true, but 
nevertheless it is measurable. On the other 
hand, the method would seem to be ruled out 

80 unless trained experts undertake the implanta- 
tion. Passive methods, in which the fish influ- 
ences the electrical field between feed elec- 
trodes, can be used to a limited extent, as 
continuous methods, in cases where severe 

85 changes in physical parameters in the water 
occur. Furthermore, then, electrical stimula- 
tion of the fish cannot be completely pre- 
cluded (see also German Au steg esc h rift No. 
23 62 084). 

90 

c) Acoustic methods: 

Acoustic methods for motility measurement 
of water organisms have greater advantages 
than the methods already mentioned since 
95 they are very insensitive to water pollution 
and in frequency ranges above about 20 kHz 
do not influence the behaviour of the fish. 
Fish-testtng apparatus which ascertains the 
movement activity by varying a stationary 

1 00 sound field is known. This apparatus is very 
sensitive and does not allow adequate filtering 
of ambient background noise. Use in flowing 
water is practically not possible. 
A further known form of acoustic fish test- 

1 05 ing apparatus ascertains the swimming move- 
ment of the test organisms when passing 
barriers (see on this score the apparatus avail- 
able under the designation AQUMEX from 
Messrs. Farad of Stockholm). The monitoring 

1 10 of a relatively large test volume which is 
nowadays necessary is, however, realisable 
only with disproportionate expenditure. 

Contact methods: 

115 All these methods are based on the fact that 
a pulse is triggered as a result of contact of a 
mechanical or pneumatic- -electrical measuring 
system by the test fish a pulse is triggered. 
This signal can then be fed to an appropriate 

1 20 evaluating or logic device by which it can be 
processed for warning and monitoring pur- 
poses. At least in the case of flowing water 
these methods have the disadvantage that 
flow resistance of the test system is increased 

1 25 and signals are triggered prematurely as a 
result of vegetation growth (see also German 
Offenlegungschrift No. 2 164 702). 

The problem of the invention is to provide a 
method (and an apparatus therefor) of the 

1 30 kind mentioned at the introduction hereof, 
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which is suitable for use in those regions of 
technology in which picture content changes 
have interpretation significance whereby ex- 
perimental animal tests and perhaps also fish 
5 tests as provided for within the framework of 
the law on waste water output or motility 
tests on test organisms can be effected in a 
fully-automatic manner without human inter- 
vention and so as to achieve the best possible 

10 results. 

This problem is solved in that the scene to 
be monitored is recorded by means of a 
recording unit such as a television camera or 
IR camera, in that the recorded picture is 

1 5 scanned in lines point-by-point, in that from 
this and by means of sync pulses for line and 
picture changes, a standardised video signal is 
provided, in fact each pair of these video 
signals issued at predeterminable time inter- 

20 vals At, are subtracted from one another po- 
int-by-point and in that the number of antico- 
incidences is ascertained as a measure of the 
picture content change during the time inter- 
val At. 

25 Further developments of the method and a 
movement analyser for carrying the method 
into effect are apparent from the sub-claims. . 

The advantages of the invention lie primar- 
ily in the fact that a non-contact measurement 

30 which does not influence the experiment 

events is involved. The method and the appar- 
atus therefor are suitable for the most varied 
test organisms without dependence on the 
dimensions of the test space. Both still and 

35 flowing media can be evaluated. 

The wide flexibility of the method, which in 
the final analysts also affects the cost ques- 
tion, in addition permits its use in many other 
spheres of technology in which change of the 

40 contents of a picture has interpretation signifi- 
cance, for example in traffic for ascertaining 
the traffic flow or in army technology for 
monitoring an area of terrain or the tracking 
of moving targets. 

46 The invention will be described further, by 
way of example, with reference to the accom- 
panying drawing in which: - 

Figure 1 is a block diagram illustrating a 
preferred embodiment of the movement ana- 

50 lyser of the invention; and 

Figure 2 is a block circuit diagram of the 
said analyser. 

As shown in Rg. 1 , a scene 20 is moni- 
tored by a recording unit 21, such as a 

55 television camera or infra-red camera. A 
worked-up signal (see in more detail Fig. 2) 
therefrom passes to a signal processor 22, 
which is coupled with a computer/control unit 
23. Here any desired predetermined paramet- 

60 ers can be introduced. Filially the desired data 
is kept ready in a registering unit 24 for 
subsequent use. 

As shown in Rg. 2, the movement analyser 
comprises a comparator 1 , a synchronisation 

65 unit 3, a write/read store 2 with an address 



counter 4, a further comparator 5, an anti- 
coincidence counter 6 as well as a control 
device 7 and a process computer or calculator 
8 with an associated programme store 9 and 
70 a connected data input 10 and data output 
11. 

In the analyser, an input signal, which 
derives from any desired picture signal source, 
is converted with the aid of the comparator 1 

75 into a binary signal and is fed to the store 2. 
The write-in rhythm is produced in the syn- 
chronisation unit 3 and synchronised with the 
input signal, so that each line is split up into, 
for example, 128 picture points or dots. The 

80 address counter 4 determines the storage 
places in which the respective picture content 
is stored. The comparator 1 can compare grey 
stages for each picture point. The decision of 
the comparator can also be a light/dark deci- 

85 sion, in which case the switching threshold is 
either fixedly set or is adjusted in accordance 
with picture brightness. In this respect, a 
good contrast must exist between any moving 
object and the background, a favourable 

90 threshold value corresponding to a certain 
extent to the mean picture brightness. The 
store requirement then amounts, for example 
for a complete television picture' (or half pic- 
ture, line jump) to 1 28 . 1 28 - 2 1 * 1 6 K. 

95 Moreover, the synchronisation unit 3 pro- 
duces reference signals for the control unit 7, 
for example the synchronised picture scan 
signal, recognition of the 1st or 2nd half 
picture or line synchronisation. The control 
1 00 device 7 clears the counters 4 and 6 in 

synchronism with the scanning of the picture 
and determines whether a new haff picture, 
(which is always either the 1st or the 2nd 
half) is read into the store 2, or whether the 
105 previous, or old, half picture remains read-out 
or stored. 

Reading-out is effected in synchronism with 
the scanning of the incoming picture signal, 
so that the old picture can be checked for 

110 variation with a new "on line", picture i.e. 
directly in the comparator 5, for example 
Exclusive-OR. The picture changes which have 
occurred are ascertained in the anti-coinci- 
dence counter 6 and transferred to the pro- 

115 cess computer 8, which may, for example, be 
a microprocessor. The processor computing 
process is fixed in the exchangeable pro- 
gramme store 9. Initiation and input of par- 
ameters or also new programmes Is effected 

1 20 by way of a data input 1 0, using for example 
a keyboard, a switch or switches or a 
punched-strip reader. The evaluated results 
appear at the data output 1 1 , which is, for 
example, a printer, a writer, or an alarm 

1 25 issuer. 

The counter state of the anti-coincidence 
counter 6 is a measure of the change in the 
picture content of two pictures which follow 
one another at a predetermined time interval 

1 30 At. If this comparison is effected constantly. 
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then the computer ascertains continuously a 
standard for (or measure of) movement in the 
picture being considered. The ascertained 
function can be smoothed (or equalised) for 
5 example in accordance with suitable algor- 
ithms, and evaluated in accordance with the 
appropriate applicability. Picture sections can 
be extracted; also the following of a moving 
object is possible. 

10 

CLAIMS 

1 . A method of automatically ascertaining 
and evaluating changes in the contents of 
pictures, for example for monitoring the move- 

1 5 ment activity of, experimental animals, charac- 
terised in that the , scene to be monitored is 
recorded by a recording unit such as a televi- 
sion camera or IR camera, in that the re- 
corded picture is scanned in lines point by 

20 point, in that from this and by means of sync 
pulses for line and picture change, a standar- 
dised video signal is provided, in that each 
pair of video signals issued at a predeter- 
mined time interval (At) are subtracted from 

25 one another point-by-point and in that the 
number of anti-coincidences is ascertained as 
a measure of the change in picture content 
during the time interval (At). 

2. A method as claimed in claim 1, char- 
30 acterised in that a problem-related program- 
mable computer serves, after the comparison, 
to evaluate the comparison state according to 
presettable criteria and in that the result is 
stored in a register unit. 

35 3. A method as claimed in claim 1 or 2, 
characterised in that an alarm is triggered 
when presettable limiting values of the extent 
of the change in picture .content are exceeded. 

4. A method as claimed in claim 1 , 2 or 3 
40 characterised in that the evaluation is of al- 
ready-recorded pictures, recorded for instance 
by means of video recorders, or is of pictures 
originating from a picture signal source. 

5. A method of automatically ascertaining 
45 and evaluating changes in the contents of 

pictures substantially as herein described with 
reference to the accompanying drawing. 

6. A movement analyser for carrying out 
the method of any of claims 1 to 5 character- 

50 ised in that it comprises a recording unit, such 
as a television camera or IR earner, having 
connected thereto, successively, a signal pro- 
cessing arrangement, a computer/control unit 
and a registering unit. 

55 7. A movement analyser as claimed in 
claim 6, characterised in that the signal pro- 
cessing arrangement has a comparator which 
receives a signal supplied by the recording 
unit and a synchronisation unit, in that the 

60 output signal of the comparator is feedable 
both to a write/read store end to a compara- 
tor connected to the output of the store, in 
that the cells of the store are selectable by 
way of an address counter which is connected 

65 to the synchronisation unit and a control de- 



vice, in that a picture which is stored in the 
store end a following picture are feedable 
synchronously by way of the control device to 
the comparator, in that an anti-coincidence 

70 counter is connected subsequently to the com- 
parator, in that the run-up counter state is 
evaluatable and various programmes and cy- 
cle controls are act i vat able by means of pro- 
gramme stores, by way of a process computer 

75 and in that the process computer is connected 
to a data input and a data output. 

8. A movement analyser as claimed in 
claim 7, characterised in that a threshold 
value which corresponds to the mean picture 

80 brightness is feedable to the comparator and 
in that, as a function of the threshold value 
being dropped below or exceeded, a decision 
can be made on white <log. 0> or black 
<log. 1 > respectively. 

85 9. A movement analyser substantially as 
hereinbefore described with reference to and 
as illustrated in the accompanying drawing. 
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